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Abstract — Cooperative behaviors are ubiquitous in na- 
ture,which is a puzzle to evolutionary biology, because the 
defector always gains more benefit than the cooperator,thus,the 
cooperator should decrease and vanish over time.This typical 
"prisoners' dilemma" phenomenon has been widely researched 
in recent years.The interaction strength between cooperators and 
defectors is introduced in this paper(in human society,it can be 
understood as the tolerance of cooperators). We find that only 
when the maximum interaction strength is between two critical 
values, the cooperator and defector can coexist,otherwise, 1) if it 
is greater than the upper value, the cooperator will vanish, 2) if 
it is less than the lower value,a bistable state will appear. 

Index Terms — cooperation,evolutionary game the- 
ory,interaction strength,tolerance,Prisoners Dilemma, population 
dynamics 

I. Introduction 

Evolutionary game theory is an efficient way to study 
evolutionary dynamics,where the fitness of a phenotype is 
dependent on its frequency relative to other phenotypes in a 
given population. Different phenotypes compete according to 
their fitness,the phenotype with greater fitness grow faster and 
the lesser grow slower.In the end,the competitive phenotype 
will survive and the weak vanish. 

The Prisoner's Dilemma (PD) is a typical model to in- 
vestigate this problem. In this game,there are two players:a 
cooperator and a defector.In each round,if the two players 
are both cooperators,every one will receive R,and if both 
defectors, they will receive P,a defector can get T by exploiting 
a cooperator, and the cooperator is left S.In PD,the Condition 
T>R>P>S should be met. Below is the payoff matrix for this 
game. 



let x = dx/dt,y = dy/dt,so the evolution equations are: 

x = x(f c - 4>) (1.2a) 

y = y{f D -4>) (1.26) 

Where cf> — xfc + vId denotes the mean fitness, above 
equations are also called the replicator equations|2|. 

Because f D - f c = x(T - R) + y(P - S) > 0,so in the 
end only the defectors exist in the population, which contradict 
the real world,since the cooperators always coexist with the 
defectors in real world. 

Cooperation is always vulnerable to exploitation by de- 
fectors. Hence,the evolution of cooperation requires specific 
mechanisms, which allow natural selection to favor cooperation 
over defection. There had been five mechanisms for the evolu- 
tion of cooperationQ, (8|: direct reciprocity J4), 0D> indirect 
reciprocity 1 5 1, kin selection, group selectionl 10|, and network 
reciprocity [6](or graph selection). Recently, a mechanism was 
provided that variable population densities and interaction 
group sizes can favor the cooperation| 12|. But,these mech- 
anisms do not take into account that the cooperators could 
adapt to the change of population frequency and adjust their 
interaction strength with the defectors. This lead to a nat- 
ural feedback between population dynamics and interaction 
strength, and favor the evolution of cooperation. 
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Fig. 1. Interaction strength. 



Without loss of generality,we assume the size of the pop- 
ulation is l,and the frequency of cooperators is x,defectors 
y, obviously, x+y=l.The fitness of cooperator and defector is 
denoted by f c and respectively. Thus, in each round: 

fc = xR + yS (1.1a) 
f D = xT + yP (1.16) 



II. Interaction strength function 

Here, we introduce a function f(x) to represent the variation 
of interaction strength according to the frequency of cooper- 
ators(see Fig. 1). It is easy to understand that the cooperators 
could adjust their interaction strength with the defectors ac- 
cording to the frequency of themselves. Thus, the strength of 
a cooperator interacts with a defector is f(x),and refuse a 



defector is l-f(x).Now,the fitness formula (1.1) are translated 
into the following formula: 

fc = xR + yf(x)S (2.1a) 

f D =xf(x)T + yP (2.1b) 

We study three forms of the interaction strength function f(x): 

1) f(x) is a constant.In this situation the cooperator 
will interact with the defector at a fix strength. Specially,if 
f(x)=0,cooperators and defectors interact by no means;if 
f(x)=l,the traditional replicator dynamics is recovered. 

2) f(x) is a monotone increasing function about x.In this 
situation the interaction strength increase along with the fre- 
quency of cooperators.Here it can be understood that the more 
cooperators there are,the more likely they are tolerant,and vice 
versa(see Fig. 2). This conforms to our common sense. 

3) f(x) is a monotonic decreasing function about x,this 
situation is contrary to 2), and it is rarely appear in real world. 




where r mean how the profitable unilateral defection is, r G 
(0,1). 

A. f(x) is a constant 

Here,let f(x)=p,p is a constant and p 6 (0, l).Now the two 
players's fitness are as follows: 

fc = x (3.1a) 

f D =px{l + r)+yr (3.16) 

substitute y=l-x into (1.2),we get: 

x = x(l — x)g(x) (3.2a) 

where 

g(x) = (l + r)(l-p)x-r (3.26) 

Let D(x) = x, solve equation D(x)=0,we get three fix points 
x* = 1,0 and r/[(l + r)(l — p)]. Below are details about the 
three situations(see Fig. 3): 

1) x* — 0,here,_D'(:r) = — r < 0,so x* = is a steady point. 

2) x* = l,here,L»'(a:) = p(l + r) - l,when p < l/(l + r),it's 
a steady point, otherwise it's unstable. 

3) x* = r/[(l + r)(l — p)],here in order to ensure x* € 
(0, l),the condition must be met: p < 1/(1 + r).When p < 
1/(1 + r),D'(x) > 0,so it's a unstable point. 




Fig. 2. Interaction strength when f(x) is a monotone increasing function about 
x.In this situation the interaction strength increase along with the frequency of 
cooperators.Here it can be understood that the more cooperators there are.the 
more likely they are tolerant. 

In next section we will discuss the situation 1) and 2) 
respectively,we will show that a fix interaction strength can't 
give rise to coexist,only when the cooperators adjust their 
interaction strength in direct proportion to their frequency can 
lead to coexist. 

III. Population dynamics based on interaction 

STRENGTH 

For simplicity and without loss of generality, we consider a 
simpler payoff matrix lfTSl : 
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Fig. 3. The cure of x when p take different values. (a)p < 1/(1 + r),it's 
bistable state. (b)p > 1/(1 + r),it's monostability.We can see no matter what 
value p takes ,they can't coexist. 

In conclusion,when f(x) is a constant,cooperators and de- 
fectors can not coexist.If p > 1/(1 + r),the population will 
be dominated by defectors in the end;if p < 1/(1 + r),the 
populations will be homogenous population in the end,as for 
which dominate the population,it depends on the initial fre- 
quency^ xq < r/[(l +r)(l — p)] the defectors win,otherwise 
the cooperators win(see Fig. 4). 

B. f(x) is a monotone increasing function 

Here, f(x) is a monotone increasing function, for simplic- 
ity, we let f(x)=kx, where k is a positive constant. Note f(x) G 
[0, fc],k can be thought as the max interaction strength or the 
max tolerance. In this situation,their fitness are as follows: 

fc = x (3.3a) 

f D = k(l + r)x 2 + yr (3.36) 
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Fig. 4. Selection Dynamic, corresponding to Fig. 3 

substitute y=l-x into (5),we get: 



where 



x = x(l — x)g{x) (3.4a) 



g(x) = -k(l + r)x 2 + (1 + r)x - r (3.46) 



Let D(x) — ±,solve equation D(x)=0,we get two boundary 
points x* = 1,0 and two internal points .Ti,X2,they are two 
roots of equation g(x)=0. Below are details about these points. 

1) dynamics on boundary points: Below is the dynamics 
on points x* = and x* — 1. 

x* = 0, In this situation, D'(0) = g(0) = -r < 0,so 
x* = is a unstable point. 

x* = 1, In this situation, D'(l) = —g{l) = k+rk— l,when 
k < l/(l+r),it's a steady point,otherwise,it's a unstable point. 

2) dynamics on internal points: In this situation,there are 
two fix points denoted by xi,a;2,they are two roots of the 
parabolic equation g(x)=0,suppose x\ ^ x%. At first, To ensure 
the existence of the solution, A = (1 + r)(l + r — Ark) ^ 
must be satisfyed,that is, 



k < 0.25(1 + l/r) 



(3-5) 



Note x\X2 = k(l +r)/r > and x\ + X2 = 1/k > 0,we 
know xi > 0,x 2 > O.Note D'(x*) = (1 - x*)x* g'(x*),so to 
determine the stability of the two points, it's only necessary 
to consider the situation of g'{x*). Below is the discussion of 
the stability of the two point(see Fig. 5). 

\)x\ <1,X2< l,to ensure this,g(l) < and (x\+X2)/2 < 
1 must be satisfied,that is,fc > 1/(1 + r)must be satisfied. In 
this situation, we get g'(x\) > and g'{x-i) < 0,so x\ is 
unstable and xi is stable. 

T)x\ < 1,X2 > l,to ensure this,g(l) > and (x% +x^)/2 < 
1 must be satisfied,that is,fc < 1/(1 + r) must be satisfied.In 
this situation, there is only one internal point xi,and it is 
unstable. 

J)x\ > 1,X2 > l,to ensure this,g(l) < and (xi +X2)/2 > 
1 must be satisfied,that is,fc > 1/(1 + r) and k < 0.5 must be 
satisfied,because 1/(1 + r) < 0.5, so this condition can never 
be met, so there is at least one internal point. 



3) Summary: By §3.1 and §3.2,let k\ = l/(l + r),fc2 = 
0.25(1 + l/r), x\ and X2 are the smaller root and larger root 
of equation g(x)=0 respectively. The conclusions are drawn as 
follows: 

1) If k < fci,x=l and x=0 are bistable state,the demarcation 
point is X\. 

2) If ki < k < fc2,x=0 and x = X2 are stable points, x — x\ 
is unstable point.The cooperators and defectors can coexist on 
the point x — X2,but when x < xi,the cooperators will still 
become extinct. 

3) If k > k2, there is no internal point,x=0 is the global sta- 
ble point,and x=l is the global unstable point,in the end,only 
the defectors exist in the population. 
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Fig. 5. The cure of x when k takes different values. 
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Fig. 6. Selection Dynamic, corresponding to Fig. 5 

4) Numerical simulation: Here,we simulate this model with 
computer, where f(x)=kx,r=0.2.At t=0,there are 50 original 
states say x = {x±, X2 ••• £50}, each is a random float in 
(0,1). In each time step, 

x(t) = x(t — 1) + x x step 



Where step mean step size,here step=l.The result is shown in 
Fig.7. 
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Fig. 7. Numerical simulation on f(x)=kx,r=0.2. corresponding to Fig. 5. Note 
(d) is a semi-stable point,that means on this point,the states will decay to the 
point x=0 in a "Half-Life" form. 



IV. Conclusion 

The Prisoner's Dilemma is a general metaphor for the 
problem of cooperationQ, G), ifTD .in this paper, we introduce 
the interaction strength,which leads to coexist of cooperators 
and defectors. 

It's shown that when interaction strength is constant,it can 
not leads to coexist.This suggests that it's unwise for the 
cooperators to be fixed and unchangeable to the defectors. 

When the interaction strength is a monotone increasing 
function about the frequency of cooperators,there is a max 
interaction strength. Only when the max interaction strength 
is between two critical value,the cooperator and defector can 
coexist. The two critical points is 1/(1 +r) and (l+r)/(4r) denoted 
by k\ and k^ respectively.Note that 1+r is the payoff of a 
defector to plunder a cooperator,r is the payoff of a defector 
meet a defector, 1 is the payoff of a cooperator meeting a 
cooperator.So k\ can be understood as the ratio of the payoff 
of a cooperator to the payoff of a defector when they meet the 
same cooperator,the same to ki. 

In general PD payoff matrix with b and c as follows: 



where a cooperator cost c to give his partner b.Note,r cor- 
respond to c/b,l corresponds to b,we can get the following 
formula: 

b , b + c 
1 < k < — — 

b + c 4c 

where k means the max interaction strength or the max tolera- 
bility.In social life,the cooperator can be seen as producer,and 
the defector predator.From the above formula we can see if the 
max tolerability is in between b/(b+c) and (b+c)/(4c) the both 
can coexist,which is a general phenomenon in most society,if 
it's greater than (b+c)/(4c),it will leads to social instability, 
if it's smaller than b/(b+c),it will towards a society in which 
almost everyone is a cooperator. 
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